Rate Distortion Theory for Sources with Abstract Alphabets and Memory

نویسنده

  • Toby Berger
چکیده

This paper is devoted to the formulation and proof of an abstract alphabet version of the fundamental theorem of Shannon's rate distortion theory. The validity of the theorem is established for both discrete and continuous parameter information sources satisfying a certain regularity condition intermediate in restrictiveness between ergodicity and weak mixing. For ease of presentation, only single letter fidelity criteria are considered during the main development after which various generalizations are indicated.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Causal Rate Distortion Function on Abstract Alphabets and Optimal Reconstruction Kernel

A Causal rate distortion function with a general fidelity criterion is formulated on abstract alphabets and the optimal reconstruction kernel is derived, which consists of a product of causal kernels. In the process, general abstract spaces are introduced to show existence of the minimizing kernel using weak∗-convergence. Certain properties of the causal rate distortion function are presented.

متن کامل

Causal Rate Distortion Function on Abstract Alphabets: Optimal Reconstruction and Properties

A causal rate distortion function with a general fidelity criterion is formulated on abstract alphabets and a coding theorem is derived. Existence of the minimizing kernel is shown using the topology of weak convergence of probability measures. The optimal reconstruction kernel is derived, which is causal, and certain properties of the causal rate distortion function are presented.

متن کامل

Universal Source Coding for Non - Stationary Processes

Universal source codes achieve the optimal performance without apriori knowledge of the source statistics. The problem of universal lossy source coding for general non-stationary processes is considered here. Fixed rate and fixed distortion lossy source codes derived from the Lempel-Ziv scheme are shown to be universal for non-stationary processes with abstract alphabets. We define the rate dis...

متن کامل

An implementable lossy version of the Lempel-Ziv algorithm - Part I: Optimality for memoryless sources

A new lossy variant of the Fixed-Database Lempel–Ziv coding algorithm for encoding at a fixed distortion level is proposed, and its asymptotic optimality and universality for memoryless sources (with respect to bounded single-letter distortion measures) is demonstrated: As the database size m increases to infinity, the expected compression ratio approaches the rate-distortion function. The comp...

متن کامل

Universal Source Coding of Finite Alphabet Sources

The application of Shannon’s rate distortion theory to real data compression practice has been limited by a lack of effective distortion measures for most real users and incomplete statistical knowledge of real sources. Universal source coding techniques attempt to overcome the latter limitation by developing codes that are effective (in the sense of approaching the theoretical rate distortion ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Information and Control

دوره 13  شماره 

صفحات  -

تاریخ انتشار 1968